The  following  abbreviations  and  acronyms  are  used  in  this 
report . 


ACETEF..  Air  Combat  Environment  Test  and  Evaluation  Facility 
AFEWES....  Air  Force  Electronic  Warfare  Evaluation  Simulator 

AFB .  Air  Force  Base 

BAF .  Benefield  Anechoic  Facility 

DT&E .  Director,  Test  and  Evaluation 

ECITFs .  Electronic  Combat  Integrated  Test  Facilities 

EC .  Electronic  Combat 

ECM .  Electronic  Counter  Measures 

EW .  Electronic  Warfare 

HWIL .  Hardware- in- the-Loop 

IDA .  Institute  for  Defense  Analyses 

JCG(T&E) .  Joint  Commanders  Group  (Test  and  Evaluation) 

LAC .  Large  Anechoic  Chamber 

LRUs .  Line  Replaceable  Units 

REDCAP . Real-time  Electromagnetic  Digitally  Controlled 

Analyzer  and  Processor 

RF .  Radio  Frequency 

SIL .  Systems  Integration  Laboratory 

TEMPs .  Test  and  Evaluation  Master  Plans 


INSPECTOR  GENERAL 
DEPARTMENT  OF  DEFENSE 
400  ARMY  NAVY  DRIVE 
ARLINGTON,  VIRGINIA  22202 


October  16,  1992 

MEMORANDUM  FOR  DIRECTOR,  TEST  AND  EVALUATION 

SUBJECT:  Audit  Report  on  Electronic  Combat  Integrated  Test 
Facilities  (Report  No.  93-006) 


We  are  providing  this  final  report  for  your  information 
and  use.  Your  comments  to  the  draft  report,  as  well  as  the 
Navy  and  Air  Force  comments  to  you  were  considered  in 
preparing  the  final  report. 

The  recommendations  are  subject  to  resolution  in 
accordance  with  DoD  Directive  7650.3  in  the  event  of 
nonconcurrence  or  failure  to  comment.  You  must  provide 
final  comments  on  the  unresolved  recommendations  by 
December  15,  1992.  See  the  "Status  of  Recommendations" 
section  at  the  end  of  the  findings  for  recommendations  you 
must  comment  on  and  the  specific  requirements  for  your 
comments.  We  also  ask  that  your  comments  indicate 
concurrence  or  nonconcurrence  with  the  material  internal 
control  weakness  highlighted  in  Part  I. 

The  courtesies  extended  to  the  audit  staff  are 
appreciated.  If  you  have  any  questions  on  this  audit, 
please  contact  Mr.  Raymond  Spencer  at  (703)  614-3995 
(DSN  224-3995)  or  Mr.  Steven  Hughes  at  (703)  693-0362 
(DSN  223-0362) .  The  planned  distribution  of  this  report  is 
listed  in  Appendix  K. 


Edward  R.  Jones 
Deputy  Assistant  Inspector  General 
for  Auditing 


Enclosure 

cc: 

Secretary  of  the  Navy 
Secretary  of  the  Air  Force 
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(Project  No.  2AB-0025) 

ELECTRONIC  COMBAT  INTEGRATED  TEST  FACILITIES 
EXECUTIVE  SUMMARY 


introduction.  Electronic  combat  integrated  test  facilities 
(ECITFs) ,  through  a  combination  of  simulated  and  actual 
hardware-in-the-loop,  provide  capabilities  for  testing  and 
evaluating  weapons  systems  hardware  and  software  in  a 

controlled  ground  test  environment.  These  facilities 
consist  of  anechoic  chambers  connected  to  various  simulation 
and  instrumentation  laboratories.  These  simulations 
stimulate  the  actual  weapon  system  into  performing  as  it 
would  in  a  real-world  environment.  A  complete  Category  I 
facility  represents  a  significant  investment  ^  in  test 
facilities  and  equipment,  estimated  to  cost  $400  million. 

ECITFs  and  their  associated  simulation  laboratories  are 
classified  in  one  of  four  categories.  Category  facilities 
provide  full  combat  environment  simulation  capabilities  and 
allow  factors  such  as  tactics,  strategy,  and  multi-platform 
effects  to  be  evaluated.  These  facilities  enable  testing  to 
be  conducted  in  full  many-on-many  electronic  combat 
environment  simulations,  including  enemy,  friendly,  and 
neutral  forces.  Category  I  facilities  can  accomplish  all 
required  test  functions. 

Objectives.  Initially,  our  objectives  were  to  review  the 
justifications  for  developing  multiple  ECITFs  and  to 
evaluate  the  applicable  internal  controls.  Our  objectives 
were  expanded,  at  the  request  of  members  of  the  Maryland 
congressional  Delegation,  to  evaluate  the  methodology  and 
evidence  used  to  support  the  Institute  for  Defense  Analyses 
(IDA)  cost  comparison  report  that  identifies  alternatives 
for  developing  Navy  and  air  Force  ECITFs. 

Audit  Results.  The  audit  determined  that  IDA  Paper  P-2727 
contained  critical  flaws  that  significantly  impacted  the 
report's  conclusions.  As  a  result,  the  report  does  not 
provide  the  Director,  Test  and  Evaluation  (the  Director) ,  a 
sound  basis  for  making  investment  decisions  (Finding  A) . 

In  addition,  we  determined  that  the  Navy  and  Air  Force 
investment  plans  for  upgrading  ECITFs  could  be  more 
economically  accomplished  through  relocation  of  assets.  As 
a  result,  the  DoD  could  save  approximately  ^  $91  million, 
while  providing  better  control  and  more  efficient  use  of 
test  assets  (Finding  B) . 
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Internal  Controls.  The  audit  identified  no  material 
internal  weakness  related  to  the  development  and 
instrumentation  of  ECITFs. 

Potential  Benefits  of  Audit.  The  DoD  can  accomplish 
significant  upgrade  to  their  integrated  test  facilities  by 
reassigning  assets  as  opposed  to  additional  procurement. 
The  potential  monetary  benefits  gained  by  implementing  the 
recommendations  B.l  and  B.2  will  be  approximately  $91 
million  (Finding  B) .  Appendix  H  summarizes  the  potential 
benefits  resulting  from  the  audit. 

Summary  of  Recommendations.  We  recommended  that  the 
Director  not  support  development  of  the  Benefield  Anechoic 
Facility  (BAF)  based  upon  the  IDA  cost  analysis  report; 
limit  further  investment  at  BAF  to  the  currently  approved 
reprogramming  authority  until  opportunities  .  for 
redistribution  of  existing  assets  are  fully  explored;  direct 
the  EW  Reliance  Group  to  accelerate  their  study  on 
transferring  Real-time  Electromagnetic  Digitally  Controlled 
Analyzer  Processor  and  Air  Force  Electronic  Warfare 
Evaluation  Simulator  facilities'  assets;  and  exercise 
oversight  to  restrict  new  Air  Force  investments  in  Real-time 
Electromagnetic  Digitally  Controlled  Analyzer  Processor  and 
Air  Force  Electronic  Warfare  Evaluation  Simulator 
facilities. 

Management  Comments.  The  Director  nonconcurred  with  the 
draft  report  recommendations  pertaining  to  funding  for  the 
BAF  and  proposed  an  alternative  recommendation.  This 
included  limiting  further  investment  in  the  BAF  to  current 
Air  Force  reprogramming  capabilities,  contingent  upon  the 
Air  Force's  agreeing  to  prohibit  program  specific  funding  at 
BAF,  until  opportunities  for  redistribution  of  existing 
assets,  as  discussed  in  Finding  B,  are  fully  explored. 

The  Director  concurred  in  principle  with  the  draft  report 
recommendations  to  transfer  selected  integrated  air  defense 
simulators  at  the  Real-time  Electromagnetic  Digitally 
Controlled  Analyzer  Processor  facility  to  the  ACETEF  and  to 
transfer  test  instrumentation  at  the  Air  Force  Electronic 
Warfare  Evaluation  Simulator  (AFEWES)  facility  to  develop 
the  BAF.  He  proposed  alternative  wording;  the  revised 
recommendations  related  to  Findings  A  and  B  are 
substantially  as  proposed  by  the  Director.  Comments  from 
the  Director  are  discussed  in  Findings  A  and  B,  and  the  full 
text  is  included  in  Part  IV.  We  request  comments  from  the 
Director  on  all  recommendations  and  estimated  potential 
monetary  benefits. 
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PART  I  -  INTRODUCTION 


Background 

Electronic  combat  integrated  test  facilities  (ECITFs) ,  through  a 
combination  of  simulated  and  actual  hardware-in-the-loop  (HWIL) , 
provide  capabilities  for  testing  and  evaluating  weapon  systems 
hardware  and  software  in  a  controlled  ground  test  environment. 
These  facilities  consist  of  anechoic  chambers  connected  to 
various  simulation  and  instrumentation  laboratories.  These 
simulations  stimulate  the  actual  weapon  system  into  performing  as 
it  would  in  a  real-world  environment.  A  complete  Category  I 
facility  represents  a  significant  investment  in  test  facilities 
and  equipment,  estimated  to  cost  $400  million. 

ECITFs  and  their  associated  simulation  laboratories  are 
classified  in  one  of  four  categories.  Category  I  facilities 
provide  full  combat  environment  simulation  capabilities  and  allow 
factors  such  as  tactics,  strategy,  and  multi-platform  effects  to 
be  evaluated.  These  facilities  enable  testing  to  be  conducted  in 
full  many-on-many  electronic  combat  environment  simulations, 
including  enemy,  friendly,  and  neutral  forces.  Category  I 
facilities  can  accomplish  all  required  test  functions.  The 
following  chart  illustrates  capabilities  of  Category  I,  II,  III, 
and  IV  facilities,  as  defined  by  the  Director,  Test  and 
Evaluation. 


Table  1 .  CATEGORIES  OF  ECITFs 

capability  Category1 


I _ 

II 

III 

IV 

Man- in- the- loop 

Yes 

Yes 

No 

No 

Many-on-many 

Yes 

No 

No 

No 

Spectrum  Coverage 

Yes 

Limited 

Limited 

Limited 

Red /Blue /Neutrals 

Yes 

Limited 

Limited 

Limited 

Closed  loop 

Yes 

Limited 

No 

No 

Open  loop 

Yes 

Yes 

Yes 

Yes 

C3  simulation 

Yes 

Limited 

Limited 

Limited 

Theater  force  level 

Yes 

No 

No 

No 

Many-on-one 

Yes 

Yes 

No 

No 

Full-scale  vehicle 

Yes 

Yes 

Yes 

No 

At  present,  a  Category  I  facility  does  not  exist.  Air  Combat 
Environment  Test  and  Evaluation  Facility  (ACETEF) ,  located  at 
Naval  Air  Warfare  Center,  Aircraft  Division,  is  the  most  advanced 
ECITF  within  DoD  and  is  designated  as  a  Category  II++1 2  facility. 


1  "DDDR&E  (T&E)  Study  of  Anechoic  Chambers  Used  to  Support  the 
T&E  of  Full  Scale  Systems,"  October  3,  1988,  pages  3  and  4. 

2  Ibid,  page  18. 


Objectives 


Initially,  our  objectives  were  to  review  the  justifications  for 
developing  multiple  ECITFs  and  to  evaluate  the  applicable 
internal  controls.  Our  objectives  were  expanded,  at  the  request 
of  members  of  the  Maryland  Congressional  Delegation,  to  evaluate 
the  methodology  and  evidence  used  to  support  the  IDA  cost 
comparison  report  that  identified  alternatives  for  developing 
Navy  and  Air  Force  ECITFs. 

Scope 

We  interviewed  Government  and  contractor  personnel  involved  in 
ECITF  management,  acquisition,  operation,  testing  and  support. 
We  also  interviewed  program  managers  identified  to  use  the 
ECITFs.  We  reviewed  current  workload  requirements  as  stated  in 
program  Test  and  Evaluation  Master  Plans  for  ECITFs  and  projected 
workloads  through  Fiscal  Year  1997  that  support  upgrades  to 
existing  facilities.  In  addition,  we  reviewed  historical 
workloads  for  these  facilities  from  October  1988  to  July  1992. 
We  also  reviewed  funding  data  for  the  proposed  upgrades. 

This  economy  and  efficiency  audit  was  performed  from  February  to 
August  1992  in  accordance  with  auditing  standards  issued  by  the 
Comptroller  General  of  the  United  States  as  implemented  by  the 
Inspector  General,  DoD,  and  accordingly  included  such  tests  of 
internal  controls  as  were  considered  necessary.  Our  Congres¬ 
sional  tasking  was  dated  August  4,  1992.  Appendix  J  lists  the 
activities  visited  or  contacted  during  the  audit. 

Internal  Controls 


The  audit  identified  no  material  internal  control  weakness 
related  to  the  development  and  instrumentation  of  ECIFT/S. 

Prior  Audits  and  Other  Reviews 

Three  prior  reports  have  been  issued  on  upgrading  and  developing 
ECITFs.  A  summary  of  the  reports  issued  is  in  Appendix  A. 
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PART  II  -  FINDINGS  AND  RECOMMENDATIONS 


A.  INSTITUTE  FOR  DEFENSE  ANALYSES  COST  ANALYSIS 

The  Institute  for  Defense  Analyses  (IDA)  Paper  P-2727  “Cost 
Comparison  of  the  Navy's  Air  Combat  Environment  Test  and 
Evaluation  Facility  (ACETEF)  and  the  Air  Force's  Electronic 
Combat  Integrated  Test  (ECIT)"  contained  critical  flaws  that 
significantly  impacted  the  report's  conclusions.  This  was  due  to 
the  absence  of  validating  projected  workload  data  at  both 
locations  and  an  improper  assumption  regarding  the  shift  capacity 
of  ACETEF.  As  a  result,  we  believe  the  report  does  not  provide 
the  Director,  Test  and  Evaluation  (the  Director) ,  a  sound  basis 
for  making  investment  decisions. 

DISCUSSION  OF  DETAILS 


Background 

In  November  1991,  Congress  directed  OSD  to  review  the  costs  and 
capabilities  associated  with  the  use  of  the  Navy's  ACETEF  to 
satisfy  aircraft  electronic  combat  ground  testing  requirements 
instead  of  developing  the  Air  Force  Electronic  Combat  Integrated 
Test  facility  at  Edwards  Air  Force  Base  (AFB) ,  California, 
referred  to  as  the  Benefield  Anechoic  Facility  (BAF) .  In 
response  to  the  Congressional  request,  the  Director  contracted 
with  IDA  to  assess  the  costs  associated  with  ACETEF  and  BAF  and 
the  capabilities  they  represent  with  respect  to  Navy  and  Air 
Force  requirements.  The  cost  analysis  examined  investment  costs 
for  facilities,  equipment,  and  software;  deployment  costs  for 
testing  at  other  than  the  primary  flight  test  location;  and 
operating  costs  for  running  the  facilities  over  a  20-year  period. 
IDA  developed  four  alternatives  to  satisfy  the  Navy  and  Air 
Force's  requirements.  Of  the  four  alternatives,  IDA  recommended 
developing  BAF  as  the  least  costly  alternative.  IDA  issued  its 
conclusions  to  OSD  in  a  report  titled  “Cost  Comparison  of  the 
Navy's  Air  Combat  Environment  Test  and  Evaluation  Facility  and 
the  Air  Force's  Electronic  Combat  Integrated  Test,”  dated  June 
1992.  The  report  was  provided  to  Congress  on  June  25,  1992. 

Certain  members  of  Congress  were  concerned  that  the  report 
contained  inaccurate  data  and  flawed  conclusions.  Accordingly, 
those  members  asked  the  Inspector  General  on  August  4,  1992, 
(Appendix  B)  to  review  the  data,  analyses,  and  conclusions  of  the 
cost  analysis  in  conjunction  with  our  audit  of  "Electronic  Combat 
Integrated  Test  Facilities”  (Project  No.  2AB-0025)  which 
evaluated  the  justification  for  developing  multiple  electronic 
combat  integrated  test  facilities.  We  evaluated  IDA's 
methodology  and  evidence  supporting  the  numbers  and  conclusions 
presented  in  its  cost  analysis  report. 
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Report  Deficiencies 

Our  review  disclosed  that  the  cost  analysis  report  contained 
two  critical  flaws  and  several  minor  discrepancies  that  adversely 
impacted  its  conclusions.  The  net  effect  was  that  IDA  erred  in 
accepting  workloads  as  projected  by  the  Services  which  resulted 
in  overstating  the  total  shifts  needed  to  meet  requirements; 
calculating  the  capacity  obtainable  for  the  alternatives 
identified;  improperly  disregarding  prior  investments  in  ECITFs; 
and  incorrectly  defining  projected  investment  costs.  This 
resulted  in  an  incorrect  comparison  of  costs  versus  needs  met. 
See  Appendix  C  for  a  complete  listing  of  the  deficiencies. 

Defining  the  Workload.  IDA  increased  the  Navy's  and  the  Air 
Force's  workload  projection  by  20  percent  for  growth  allowance  to 
a  level  of  184  weeks  and  152  weeks  per  year,  respectively.  IDA 
accepted  the  Services'  workload  without  validation.  This  was 
generally  consistent  with  their  tasking  to  use  Service  estimates 
to  the  maximum  possible  but  not  with  their  tasking  to  review 
Service— provided  data  for  reasonableness,  completeness,  and 
consistency.  We  validated  80  percent  of  the  Navy  and  Air  Force's 
workload  projections  for  the  ACETEF  and  the  BAF  with  the 
applicable  program  managers.  The  IG  validation  included  a  review 
of  Test  and  Evaluation  Master  Plans,  funding  documents,  and 
interviews  with  program  managers.  Based  on  our  review,  we 
reduced  both  the  Navy  and  Air  Force's  workload  projections  by 
63  percent.  Thus,  the  documented  workload  was  37  percent  of  the 
projected  requirement.  IDA  concluded  on  page  E— 4  of  its  report 
that  if  the  actual  workload  requirement  were  50  to  75  percent  of 
projected,  then  Alternative  2  (build  a  large  chamber  at  ACETEF) 
would  be  the  most  cost-effective  choice.  In  May  1992,  we 
informed  the  Director's  office  of  our  conclusion  that  both  the 
Navy  and  Air  Force's  workload  projections  were  significantly 
overstated.  We  believe  IDA  should  have  been  aware  that  using 
unvalidated  Service  estimates  would  compromise  their  results. 
See  Appendix  D  for  the  programs  reviewed. 

Computing  the  Shifts  Needed  to  Meet  Requirements.  IDA 
computed  that  a  total  of  6.9  shifts  would  be  required  to  handle 
the  Navy  and  Air  Force's  projected  ECITF  workload,  as  shown  in 
Table  2  below  and  on  page  vii  of  its  report. 

Table  2.  Future  Requirements  for  ECITF  Chambers 

_ (Average  Shifts  Per  Day) _ 

Small  Large 

User  Anechoic  Chamber  Anechoic  Chamber  Total 

Navy  2.0  1.8  3.8 

Air  Force  1.4  1.7  3 . 1 

Total  3^  3.5  JyJ, 

However,  as  discussed  above,  the  Navy  and  Air  Force's  workload 
projections  were  significantly  overstated.  Reducing  the 

projections  to  reflect  validated  data  would  show  that  the  total 


4 


shifts  required  would  drop  from  6.9  to  2.5.  Therefore,  IDA'S 
chart  on  page  vii  should  have  shown  as  Table  3. 

Table  3.  Future  Requirements  for  ECITF  Chambers 

_ (Average  Shifts  Per  Day) 

Small  Large 

User  Anechoic  Chamber  Anechoic  Chamber  Total 

Navy  .7 

Air  Force  ♦ 5 

Total  1^2 

The  significance  of  IDA  showing  ECITF  workload  projections  at 
6.9,  as  opposed  to  2.5,  is  that  it  draws  the  conclusion  that  no 
one  facility  could  handle  all  ECITF  workload  projections. 

Calculating  the  Capacity  Obtainable  for  the  Alternatives 
Identified.  IDA  developed  four  alternatives  for  satisfying  Navy 
and  Air  Force  ECITF  capacity  requirements  as  follows: 

o  Alternative  1 :  Operate  ACETEF  at  2.5  shifts  per  day 
instead  of  the  current  1.5.  This  alternative  would  not  provide 
for  a  large  anechoic  chamber. 

o  Alternative  2:  Build  a  large  anechoic  chamber  at 
ACETEF  and  operate  two  shifts  in  each  chamber. 

o  Alternative  3:  Develop  the  BAF  and  operate  both  BAF 
and  ACETEF  at  2.5  shifts  per  day. 

o  Alternative  4:  Build  a  large  anechoic  chamber  at 
ACETEF  and  develop  BAF.  The  ACETEF  would  operate  at  two  shifts 
in  each  chamber  per  day  and  BAF  would  operate  at  2.5  shifts  per 
day. 

IDA  eliminated  Alternatives  1  and  4  from  further  consideration 
as  being  ineffective  and  too  costly,  respectively.  Therefore, 
Alternatives  2  and  3  were  the  primary  considerations  for  review. 
Figure  1  shows  IDA'S  estimate  of  the  capacity  obtainable  by 
Alternatives  2  and  3,  as  reflected  on  page  viii  of  its  report. 
We  modified  IDA's  estimate  for  alternative  2  to  reflect  the 
addition  of  a  fifth  shift  at  ACETEF.  The  result  is  shown  with 
the  dotted  line  on  Figure  1. 


.7 

-jJS 

1.3 


1.4 

2.5 
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Figure  1  Requirement*  Satisfied  bj  the  Alternative* 


The  chart  shows  that  Alternative  3  provides  15  percent  more 
capacity  than  Alternative  2  (72  percent  versus  57  percent) . 
However,  the  key  difference  between  the  two  alternatives  was  in 
the  number  of  shifts  assigned  each  alternative.  Alternative  2 
was  limited  to  four  shifts  but  Alternative  3  was  allowed  five 
shifts.  We  validated  that  one  shift  equates  to  15  percent 
additional  capacity.  Thus,  adding  a  shift  to  Alternative  2  would 
generate  the  same  capacity  as  reflected  in  Alternative  3. 
Consequently,  there  would  have  been  no  difference  in  capacity 
obtainable  between  building  a  large  anechoic  chamber  at  ACETEF  or 
in  developing  BAF.  IDA  could  not  provide  us  documentary  support 
for  its  rationale  in  limiting  Alternative  2  to  four  shifts  per 
day.  IDA's  approach  had  a  profound  impact  on  all  subsequent 
analysis  and  conclusions,  in  that  it  distorted  the  portrayal  of 
the  comparative  capacities  of  ACETEF  and  BAF. 

Prior  Investments  in  ECITFs.  IDA's  cost  analysis 
disregarded  the  Navy's  $249.5  million  investment  in  ACETEF 
laboratories  and  the  Air  Force's  $60.2  million  investment  in  the 
BAF  large  chamber.  IDA  classified  these  investments,  on  page 
8  of  its  report,  as  sunk  costs  and  excluded  them  from  the 
analysis.  We  believe  this  is  inappropriate  because  future 
investments  would  build  on  previously  acquired  capabilities  to 
enhance  an  individual  laboratory's  capacity  or  to  achieve 
complete  testing  through  diversification. 
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Defining  Projected  Investment  Costs.  IDA's  projected 
investments  for  ACETEF  and  BAF  do  not  reflect  an  accurate 
comparison  between  the  two  alternatives.  First,  IDA  included  the 
Navy  and  OSD's  planned  $60.5  million  investment  at  ACETEF  in  both 
the  Navy  and  Air  Force  figures  of  $128.5  million  and 
$228.9  million,  respectively.  The  $60.5  million  represents 
upgrading  ACETEF  to  a  Category  I  facility  which  exceeds  that 
proposed  for  BAF.  Second,  IDA's  proposed  $168.4  million 
investment  in  BAF  only  provides  BAF  with  the  existing 
capabilities  at  ACETEF  (Appendix  E) .  For  a  true  comparison 
between  two  alternatives  with  like  capabilities,  it  would  have  to 
be  assumed  that  a  large  chamber  costing  $68  million  would  be 
required  for  ACETEF.  Therefore,  the  accurate  projected 
investments,  for  comparison  of  like  capabilities,  would  be 
$68  million  for  the  Navy  and  $168.4  million  for  the  Air  Force. 
The  planned  BAF  investments  equating  to  ACETEF' s  capabilities  are 
shown  in  Appendix  F. 

Comparing  the  Cost  Versus  Needs  Met.  As  previously 
discussed,  our  review  disclosed  that  the  capacity  for  Alternative 
2  was  understated  by  one  shift.  Therefore,  IDA's  computation  of 
costs  versus  needs  met  was  also  flawed.  As  shown  in  Figure  2,  IDA 
computed  the  cost  versus  needs  met  to  be: 
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However,  equalizing  the  capacities  between  the  two  alternatives 
would  have  shown  that  Alternative  2  would  offer  the  lower  cost 
per  unit  of  capacity  achieved  ($454  million  and  50  percent  versus 
$486  million  and  50  percent) . 

It  should  be  noted  that  IDA  included,  within  the  $454  million 
cost  for  Alternative  2,  $272  million  to  deploy  Air  Force  aircraft 
to  ACETEF.  However,  only  $28  million  was  included  in 
Alternative  3  for  Navy  deployment  to  BAF.  We  concluded  that  the 
cost  to  deploy  should  not  have  been  included  in  the  analysis  for 
several  reasons.  First,  deployment  costs  for  personnel  and 
aircraft  are  not  major  cost  factors  even  though  costs  exceed 
$2  million.  Second,  estimates  of  Air  Force  deployment  costs  to 
ACETEF  were  for  equipment  to  support  an  F-22  Systems  Integration 
Laboratory  (SIL)  valued  at  $27  million,  Line  Replaceable  Units 
(LRUs)  valued  at  $89  million,  contractor  operations  at  the  SIL 
estimated  at  $115  million,  and  added  flight  tests  estimated  to 
cost  $127  million.  IDA  reduced  these  costs  approximately 
60  percent.  Further,  IDA  did  not  factor  similar  costs  for  the 
Navy  to  deploy  its  aircraft  to  Edwards  AFB,  although  IDA 
acknowledged  that  deployment  for  large  aircraft  requires  more 
people  and  support.  We  believe  the  deployment  costs  of  the 
Services  would  more  or  less  offset  each  other. 

To  adjust  for  the  errors  that  we  perceived  in  the  IDA  Report,  we 
removed  deployment  costs  from  both  alternatives  and  decreased 
Navy  and  Air  Force's  investment  costs  by  $60.5  million  (see 
page  7,  Defining  Projected  Investment  Costs).  We  also  increased 
the  operating  cost  for  Alternative  2  by  $21.6  million  to 
$75.7  million  to  fund  the  additional  shift.  These  changes  show  a 
significant  disparity  between  the  cost  to  capacity  achieved  for 
the  alternatives,  as  shown  in  Figure  3. 
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As  indicated  in  the  above  chart.  Alternative  2  offers  the  same 
capacity  for  less  than  half  the  cost  of  Alternative  3 
($143.7  million  versus  $397.5  million). 

Affordability  of  Systems  Integration  Laboratories.  Both  the 
Navy  and  Air  Force  agree  that  the  ideal  test  method  would  involve 
collocating  the  SIL  at  the  ECITF.  The  Air  Force  stresses  that 
their  collocation  philosophy  is  even  more  important  when  testing 
future  systems,  such  as  the  F-22  with  its  integrated  avionics. 
The  Director  supports  the  Air  Force  methodology  as  necessary  for 
testing  future  systems.  The  Navy  has  shown  that,  while 
desirable,  collocation  was  not  mandatory  for  past  systems.  The 
ideal  situation  does  not  necessarily  represent  the  most 
economical  application  of  DoD  funds. 

The  Navy  has  acknowledged  that  the  cost  of  supporting  two  SILs, 
one  at  the  test  range  and  one  required  by  the  contractor,  was 
prohibitive  for  most  programs.  Maintaining  a  SIL  at  the  test 
range  requires  an  additional  set  of  LRUs.  LRUs  are  specific 
aircraft  components,  such  as  radars  and  jammers,  and  represent 
the  major  cost  in  equipping  SILs.  The  LRUs  for  the  B-2  were 
estimated  to  cost  $50  million;  for  the  F-22,  they  were  estimated 
to  cost  $89  million.  Further,  the  Air  Force  claims  that  although 
the  SILs  do  not  correct  the  anomalies,  they  provide  a  more 
efficient  and  cost-effective  means  of  identifying  anomalies  and 
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collecting  data  to  support  weapon  system  performance  measurement 
and  anomaly  definition. 

Conflicting  BAP  Cost  Estimates. 

We  requested  Edwards  AFB  to  provide  projected  costs  for  BAF  in 
March  1992  and  again  in  June  1992.  The  Air  Force  stated  on  both 
occasions  that  funding  had  been  withdrawn  before  estimates  for 
the  individual  building  blocks  were  developed.  However,  the  Air 
Force  verbally  informed  us  that  the  total  cost  to  upgrade  BAF  to 
a  category  l  facility  would  be  approximately  $498  million.  In 
August  1992,  IDA  informed  us  that  the  Air  Force  had  not  provided 
them  cost  estimates  and  thus  IDA  developed  an  estimate  of  $168 
million  based  on  ACETEF  capabilities.  In  August  1992,  the  Air 
Force  provided  us  an  estimate  of  $179  million  to  instrument  the 
BAF.  A  review  of  a  previous  Air  Force  briefing  identified  a  1990 
chart  showing  the  cost  to  instrument  BAF  under  the  building  block 
approach  to  be  $398  million.  BAF' s  cost  estimates  are  shown  in 
Table  4  and  in  more  detail  in  Appendix  G. 

Table  4  Estimates  to  Instrument  BAF 


Source 


Date 


Estimate 


Edwards  AFB 
Edwards  AFB 
IDA 

Edwards  AFB 


1990 

June  1992 
June  1992 
August  1992 


$398  million* 
$498  million* 
$168  million** 
$179  million** 


*  Represents  cost  to  upgrade  BAF  to  Category  I. 

**  Represents  current  cost  to  instrument  BAF  to  Category  II 

The  difficulty  in  developing  a  cost  estimate  for  BAF  is  that  the 
Air  Force  has  not  identified  the  specific  equipment  required  for 
each  of  the  building  blocks.  It  was  not  clear  if  the  Air  Force's 
current  estimate  of  $179  million  to  instrument  BAF  was  all 
inclusive  or  if  significant  additional  funding  would  be  provided 
directly  by  programs  such  as  the  F-22. 

Conclusion 


It  is  our  opinion  that  IDA's  reliance  on  the  integrity  of  the 
projected  workload  data,  omission  of  a  fifth  shift  at  ACETEF,  and 
disregard  of  prior  investments  in  ECITFs  was  inappropriate. 
Substituting  revised  data  into  IDA's  analysis  shows  that  building 
a  large  chamber  at  ACETEF  would  be  the  most  cost-effective, 
lowest  risk  alternative  based  on  cost  alone.  However,  the  cost 
versus  benefit  of  having  collocated  SILs  and  ECITFs  is  an  issue 
that  is  not  entirely  quantifiable  in  dollars. 

Since  issuance  of  the  draft  report,  we  met  with  the  Director  on 
proposed  changes  to  the  recommendations.  The  Director  proposed 
limiting  the  investment  in  BAF  to  the  Air  Forces 's  reprogramming 
capability.  Reprogramming  action  refers  to  the  transfer  of  funds 
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appropriated  for  a  certain  purpose  to  another  use  within  a 
particular  appropriation.  The  Air  Force  reprogramming  capability 
is  limited  to  $4  million. 

RECOMMENDATIONS,  MANAGEMENT  COMMENTS ,  AND  AUDIT  RESPONSE 
We  recommend  that  the  Director,  Test  and  Evaluation: 

1.  not  support  development  of  the  Benefield  Anechoic 
Facility  based  upon  the  Institute  for  Defense  Analyses'  cost 
analysis  report,  and 

2.  limit  further  investment  at  the  Benefield  Anechoic 
Facility  to  $4  million,  the  Air  Force's  current  reprogramming 
capability,  contingent  upon  the  Air  Force's  agreeing  to  prohibit 
program  specific  funding  at  the  Benefield  Anechoic  Facility, 
until  the  opportunities  for  redistribution  of  existing  assets,  as 
discussed  in  Finding  B,  are  fully  explored. 


Management  Comment.  The  Director  nonconcurred  with  the  draft 
report  Recommendations  A.l.  and  A.  2.  and  identified  four  areas 
of  concern  as  discussed  below: 

o  Test  capabilities.  The  Director  stated  that  our  audit 
was  based  on  assumptions  relating  to  current  or  past  generation 
avionics  technology  systems,  in  particular  electronic  combat 
subsystems.  He  further  stated  that  today's  test  capabilities  are 
inadequate  to  test  future  avionics  systems  efficiently. 

o  Workload  validation.  The  Director  stated  that  the  Test 
and  Evaluation  Master  Plans  and  program  manager  budget 
documentation  were  not  dependable  sources  for  long-term  test 
resource  planning  or  requirements  validation;  that  each  Service 
has  revalidated  sufficient  workload  to  justify  Integrated  System 
Test  Facilities  at  each  of  the  (two)  principal  Service  aircraft 
development  sites,  particularly  in  view  of  next-generation 
integrated  systems;  that  each  Service  has  been  working  (since 
1988)  through  the  Joint  Commanders  Group  (Test  and  Evaluation) 
[JCG(T&E) ]  to  conduct  joint  reviews;  and  that  he  was  confident 
that  (the  Services')  workload  estimates  were  more  representative 
than  (the  IG's) . 

o  Reliance  effort.  The  Director  stated  that  he  has 
installed  a  Reliance  approach  to  test  resource  planning.  He 
further  stated  that  this  process,  even  in  its  early  stages,  has 
borne  out  the  need  for  the  two  primary  facilities  that  are  the 
focus  of  our  audit. 

o  Facility  shifts.  The  Director  stated  that  he  was  not 
aware  of  any  analysis  that  would  support  five  shifts  at  the 
ACETEF  or  its  associated  chamber.  That,  to  the  contrary,  the 
Navy  maintains  that  even  four  shifts  would  require  the  right 
combination  of  customer  needs  and  optimal  scheduling  of  both 
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people  and  equipment.  He  further  stated  that  the  number  of 
shifts  available  at  ACETEF  is  not  simply  a  matter  of  summing 
potential  shift  work  at  two  separate  locations:  BAF  and  ACETEF. 

Audit  Response.  We  disagree  with  the  Director's  comments  as 
discussed  below. 

o  Test  capabilities.  Our  audit  reviewed  the  justifications 
for  developing  multiple  comprehensive  electronic  combat 
integrated  test  facilities.  In  addition  to  past  and  current 
systems,  we  reviewed  the  future  systems  supporting  the  proposed 
upgrades  to  the  BAF  and  ACETEF.  In  addressing  future 
requirements  the  Air  Force  proposed  working  with  the  Navy  to 
establish  a  correlation  between  BAF  functions  and  ACETEF 
capabilities  existing  or  under  development  at  ACETEF.  The 
results  of  the  Air  Force/Navy  effort  are  presented  in  Appendix  E. 
The  conclusion  from  this  effort  is  that  the  planned  capabilities 
of  the  two  facilities  were  essentially  equal. 

o  Workload  validation.  Our  workload  methodology  included 
analyzing  the  Test  and  Evaluation  Master  Plans  (TEMPs) ,  reviewing 
budget  documents,  and  interviewing  the  program  manager.  The  TEMP 
is  an  executive  level  document  that  is  intended  to  identify  the 
necessary  developmental  test  and  evaluation  and  operational  test 
and  evaluation  activities  and  the  major  test  events  to  be 
conducted.  It  outlines  the  needs  for  resources,  such  as  test 
ranges,  targets,  expendable  ordnance,  and  aircraft  services. 
Accordingly,  test  schedules  must  be  budgeted  to  preclude  program 
cost  overruns  and  program  managers  are  responsible  for  meeting 
program  milestones.  We  acknowledge  that  for  various  reasons 
all  future  test  requirements  may  not  get  recorded  in  the  TEMP  or 
budgeted  for.  Accordingly,  we  have  allowed  for  a  20  percent 
growth  factor  in  Table  5. 

We  did  not  have  the  opportunity  to  verify  the  Navy  and  Air 
Force's  revalidated  workloads.  However,  their  revised  estimates 
support,  rather  than  refute,  our  methodology  in  using  TEMPs, 
budget  documents,  and  discussions  with  program  managers  to 
validate  workloads.  For  example,  workloads  were  reduced 
23  percent  to  91  weeks  and  46  percent  to  82  weeks  by  the  Navy  and 
Air  Force,  respectively.  The  Navy  had  ACETEF  revalidate  their 
own  projections,  and  the  Air  Force  contacted  program  directors. 
Further,  the  two  Services'  revalidated  workloads  show  that  only 
four  shifts  (two  per  chamber)  would  be  required  to  meet  the 
combined  workload.  A  two-shift  operation  accounts  for  104  weeks 
per  year.  Details  are  shown  below. 
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Table  5 .  Services '  Revalidated  Workload 

(Small  and  Large  Chambers) 


Weeks  per  year#  Air  Force  82 
Weeks  per  year,  Navy  _iLl 
Total  combined  workload  173 
Additional  20  percent  growth  allowance  35 
Grand  Total  Weeks  Per  Year  208 

Weeks  per  year  per  chamber  (208  divided  by  2)  104 


The  Air  Force  revalidated  all  of  the  workload;  however,  the  Navy 
limited  the  revalidation  to  the  programs  identified  in  the 
report.  We  applied  the  revalidated  percentage  to  our  universe  to 
compute  the  91  weeks  per  year. 

o  Reliance  effort.  The  Reliance  concept  provides  a  step 
forward  in  reviewing  and  planning  test  capabilities  and 
requirements.  However,  the  conclusions  reached  by  the  Reliance 
groups  are  not  always  accurate.  For  example,  in  computing  the 
projected  workload  for  BAF,  the  Reliance  group  calculated  a 
190  week  per  year  requirement,  as  shown  on  page  43  of  the  IDA 
report.  This  is  greater  than  twice  the  Air  Force's  revalidated 
projection. 

o  Facility  shifts.  The  issue  of  a  fifth  shift  at  ACETEF  is 
a  moot  point  since  the  Services'  revalidated  workload  does  not 
exceed  a  four-shift  requirement.  However,  the  Director's 
comments  are  misleading.  The  Navy  provided  documentation  to  show 
that  four  shifts  were  not  the  absolute  maximum  number  that  ACETEF 
could  support.  Further,  the  Navy's  comment  concerning  the  need 
for  scheduling  explained  how  it  currently  was  possible  to  do  the 
equivalent  output  of  1  1/2  shifts  with  only  1  shift  of  people. 
The  Navy  also  provided  documentation  to  show  that  the 
infrastructure  (equipment)  was  in  place  to  support  multiple 
simultaneous  tests  in  two  chambers  and  a  shielded  hangar. 
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B.  CONSOLIDATION  OF  FACILITIES 


The  Navy  and  Air  Force  have  investment  plans  to  upgrade  ACETEF 
and  BAF,  respectively,  that  could  be  accomplished  more 
economically  by  relocating  existing  assets  to  satisfy  a 
significant  portion  of  their  needs.  Relocation  of  equipment  had 
not  been  given  adequate  consideration  by  the  Director  and 
previous  Reliance  reviews.  We  identified  specific  equipment 
that,  if  redistributed,  could  save  DoD  approximately  $91  million 
while  providing  better  control  and  a  more  efficient  use  of  test 
assets. 


DISCUSSION  OF  DETAILS 


Background 

In  1988,  the  Air  Force  requested  reprogramming  authority  to  shift 
$52  million  in  funds  provided  for  B-1B  production  to  facilities 
to  build  BAF.  The  Commander,  Air  Force  Systems  Command  (the 
Commander) ,  testified  before  Congress  that  the  Air  Force  already 
owned  all  the  instrumentation  needed  for  BAF  and  that  the 
instrumentation  would  be  moved  to  BAF.  Members  of  Congress  made 
repeated  references  to  the  Navy's  ACETEF  capabilities  and  planned 
investments.  The  Commander  reassured  Congress  that  the  Air  Force 
would  transfer  assets  to  BAF,  thereby  eliminating  the  requirement 
for  additional  investment,  and  that  DoD  would  not  end  up  with  a 
redundant  capability.  The  Commander  further  stated  that  the  only 
additional  cost  would  be  for  items  specific  to  individual 
aircraft,  such  as  power  carts  and  cooling  equipment,  but  not  a 
modification  to  BAF  for  additional  instrumentation.  As  of 
1992  the  only  instrumentation  transferred  or  relocated  to  BAF  was 
a  signal  generator  from  the  B-l  program;  however,  the  Air  Force 
has  invested  $8  million  in  upgrades  that  included  a  new  signal 
generator  and  a  hoist. 

Our  review  focused  on  four  ECITFs  (two  Government  facilities  and 
two  Government-owned  contractor-operated  facilities) ,  as  follows: 

o  ACETEF,  Naval  Air  Warfare  Center  -  Aircraft  Division, 
Patuxent  River,  Maryland 

o  BAF,  Air  Force  Flight  Test  Center,  Edwards  AFB, 

California 

o  Air  Force  Electronic  Warfare  Evaluation  simulator 

(AFEWES) ,  Air  Force  Plant  No.  4,  Fort  Worth,  Texas 

o  Real-time  Electromagnetic  Digitally  Controlled  Analyzer 
and  Processor  (REDCAP) ,  Calspan  Corporation,  Buffalo,  New  York 
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Planned  ECITF  Investments.  The  Navy  is  planning  $51  million  in 
upgrades  to  the  ACETEF,  while  the  Air  Force  is  planning  $179 
million3  in  upgrades  to  BAF.  The  $179  million  consists  of  $40 
million  established  in  the  future  year  defense  plan  specifically 
for  upgrading  the  BAF,  and  the  balance  to  be  provided  by  programs 
such  as  the  F-22.  Ultimately,  the  Air  Force  wants  to  develop  the 
BAF  capability  so  it  is  comparable  to  that  at  ACETEF,  as 
illustrated  in  appendix  E,  page  33.  We  identified  government 
assets  at  defense  contractors  that  could  be  used  to  offset  the 
$91  million  of  funds  programmed  for  these  upgrades.  Specifically, 
the  AFEWES  and  REDCAP  test  instrumentation  should  be  relocated  to 
the  ACETEF  and  to  BAF,  thereby  significantly  enhancing  ACETEF 
toward  a  Category  I  facility  and  upgrading  the  BAf  toward  a 
Category  II  facility.  A  description  of  the  AFEWES  and  REDCAP 
capabilities  follows. 

AFEWES .  This  Government-owned,  contractor-operated  facility 
is  a  major  electronic  combat  test  asset  managed  by  Air  Force 
Developmental  Test  Center.  The  facility  has  been  operated  and 
maintained  by  General  Dynamics  Corporation,  Fort  Worth  Division 
since  its  inception  in  1958.  The  role  of  the  AFEWES  is  to 
provide  technical  evaluations  of  electronic  combat  systems,  such 
as  electronic  countermeasures  systems  (ECM) ,  radar  warning 
receivers,  decoys,  and  techniques  in  a  simulated  threat 
environment.  Currently,  AFEWES  has  a  large  array  of  anti¬ 
aircraft  artillery,  surfact-to-air  missiles,  anti-air  missiles, 
and  command,  control,  and  communications  threat  system 
simulations  against  which  ECM  systems  can  be  evaluated. 

AFEWES  simulations  are  one  of  two  types:  open  loop  or  closed 
loop.  Open  loop  simulators,  such  as  the  multiple  emitter 
generator,  provide  a  one-way  path  from  the  simulator  to  the 
electronic  combat  system  and  are  used  to  evaluate  electronic 
combat  receiver/passive  receivers  in  a  dense  emitter  environment. 
Closed  loop  simulators,  such  as  the  SA-8  simulation,  provide  a 
two-way  path  between  the  threat  simulator  and  the  electronic 
combat  system  and  are  used  to  develop/optimize  electronic  combat 
techniques,  evaluate  low  observables,  maneuvers,  and  terrain 
masking/ clutter  effects. 

REDCAP.  This  Government-owned,  contractor-operated  facility 
is  a  major  electronic  combat  simulation  asset  that  is  used  to 
evaluate  actual  electronic  combat  equipment,  concepts,  and 
tactics  against  foreign  integrated  air  defense  systems.  It  is 
located  at  Calspan  Corporation's  Advanced  Technology  Center  in 
Buffalo,  New  York.  REDCAP  is  a  laboratory  hybrid  test  resource 
that  combines  all  the  elements  of  an  integrated  air  defense 
system  with  real-world  signal  densities  in  real  time.  The  REDCAP 
facility  houses  a  complex  real-time  simulator  that  represents  the 
long-range  future  Soviet  Union  Airborne  Warning  and  Control 
System  threat  to  permit  evaluation  of  penetration  ECM  techniques 
and  equipment. 

3  See  page  10  for  range  of  estimates  for  BAF. 
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REDCAP  simulates  the  threat  air  defense  system  from  radars  that 
detect  penetrators  up  to  battle  management  and  various  weapons 
direction  points.  At  key  points,  simulated  weaponry  is  directed 
against  the  vehicles  penetrating  the  air  defense  system. 

Need  for  Consideration  of  Relocation 

The  Director  has  not  adequately  considered  relocating  existing 
test  assets  as  an  alternative  to  new  investment  at  ACETEF  and 
BAF.  The  Director,  in  June  1992,  endorsed  the  Institute  for 
Defense  Analyses'  cost  comparison  that  recommends  new  investments 
for  upgrading  BAF  capabilities.  However,  we  believe  a  better 
alternative  is  to  transfer  assets  at  REDCAP  and  AFEWES,  with  an 
identified  replacement  value  of  $303  million,  to  the  ECITFs. 
These  assets  have  been  upgraded  or  are  scheduled  for  upgrades 
which  include  all  support  documentation.  Consolidating  these 
assets  would  not  degrade  the  integrity  of  individual  capabilities 
and  would  permit  greater  utilization  by  integrating  the  various 
capabilities  into  a  more  complete  test  package. 

Impact  of  Relocating  Assets.  We  compared  the  existing 
capabilities  at  four  test  sites  to  determine  the  potential  for 
consolidating  fragmented  test  functions  into  ECITFs.  The  four 
sites  and  their  capabilities  are  shown  in  Table  6. 

Table  6 .  current  Capabilities 


Capabilitv 

ACETEF 

BAF 

AFEWES 

REDCAP 

Bomber  Chamber 

X 

Fighter  Chamber 

X 

Open  Loop 

X 

X 

X 

X 

Closed  Loop 

X 

X 

Man- In-The-Loop 

X 

X 

Red  Integrated  Air  Defense 

Systems 

X 

Flight  Simulator 

X 

Infrared  Lab 

X 

Table  7 .  Proposed  Consolidation  of  Capabilities 


Capability 

ACETEF 

BAF  AFEWES  REDCAP 

Bomber  Chamber 
Fighter  Chamber 

X 

X 

Open  Loop 

X 

X! 

Closed  Loop 

X1 

X1 

Man-In-The-Loop 

X2 

X2 

Red  Integrated  Air 

Defense  System  X* 

X2 

Flight  Simulator 

Infrared  Lab 

X1 

X1 

1  Transferred  from  AFEWES 

2  Transferred  from  REDCAP 
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Relocating  selected  integrated  air  defense  systems,  as  identified 
in  Table  7,  would  increase  ACETEF's  capabilities  to  a  Category  I 
facility  and  the  BAF  to  a  Category  II  facility. 

Cost  to  Transfer  Assets.  We  found  that  the  Air  Force 
Electronic  Combat  Office  computed  the  cost  for  relocating  AFEWES 
and  REDCAP  test  instrumentation  would  be  approximately  $20 
million.  This  would  include  disassembling,  packaging,  shipping, 
and  fabricating  costs  but  excludes  the  purchase  or  replacement  of 
contractor  furnished  equipment.  Air  Force  Materiel  Command 
developed  an  estimate  of  $105  million  for  relocating  AFEWES  and 
REDCAP.  However,  our  analysis  disclosed  $54  million  were  allowed 
to  upgrade  the  systems  and  the  supporting  documentation.  In 
addition,  $20  million  was  estimated  for  facility  preparation. 
The  cost  to  upgrade  is  a  separate  issue  from  relocating.  If  it 
is  necessary  to  upgrade  these  systems,  that  cost  would  be 
incurred  if  the  equipment  remained  in  its  present  location  or  is 
moved  as  recommended. 

Accounting  for  Down  Time.  Relocation  of  tests  assets  is 
likely  to  have  an  adverse  impact  on  customer  test  schedules  but 
we  have  no  basis  for  quantifying  this  factor.  However, 
relocation  of  AFEWES  and  REDCAP  test  assets  could  be  planned  to 
coincide  with  scheduled  upgrades  when  it  would  have  the  least 
impact  on  customer  testing.  We  noted  that  a  significant  amount 
of  the  test  equipment  at  both  locations  has  been  scheduled  for 
upgrades . 

Cost  for  Dedicated  Lines.  We  investigated  an  alternative  to 
transferring  the  test  equipment  which  included  data  linking  the 
AFEWES  and  REDCAP  facilities,  with  dedicated  lines  to  share 
capabilities  between  ECITFs.  We  found  that  data  linking  could 
not  be  used  in  tests  requiring  real-time  processing  that  limits 
the  distances  between  facilities  using  fiber  optic  lines  to  1200 
feet.  Further,  data  linking  through  dedicated  lines  would  cost 
approximately  $40  million.  We  found  that  air  Force  Materiel 
Command  had  developed  cost  of  $4  million  to  $5  million  for 
limited  linking  and  $10  million  to  $12  million  for  comprehensive 
linking.  In  further  support  of  these  estimates,  the  Air  Force 
Electronic  Combat  Office  computed  the  cost  for  constructing  each 
data  link  would  be  $2.2  million.  However,  they  acknowledged  the 
main  cost  was  not  in  constructing  the  links  but  in  building  the 
interfaces.  As  many  as  four  dedicated  lines  would  be  required  as 
follows: 

o  REDCAP  to  AFEWES 

O  REDCAP  to  AFEWES 

O  REDCAP  to  BAF 

o  AFEWES  to  BAF 

Therefore,  we  concluded  that  data  linking  was  neither 
practical  nor  economical. 
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Conclusion 


Relocating  selected  integrated  air  defense  systems  test 
instrumentation  assets  from  REDCAP  to  ACETEF  would  significantly 
increase  Navy's  ECITF  capabilities  and  eliminate  the  expenditure 
of  approximately  $51  million.  Likewise,  relocating  AFEWES  to  BAF 
would  significantly  increase  the  Air  Force's  ECITF  capabilities 
and  avoid  the  expenditure  of  $40  million  for  test 
instrumentation.  Thus  the  combined  effect  for  DoD  would  be  a 
cost  avoidance  of  $91  million  from  FYs  1993  to  1996. 


RECOMMENDATIONS  FOR  CORRECTIVE  ACTION 
We  recommend  that  the  Director,  Test  and  Evaluation: 

1.  direct  the  Navy  to  accelerate  and  refine  the  electronic 
combat  test  plan  study  to  assure  that  the  cost,  liabilities, 
benefits,  and  schedule  for  transferring  Real-time  Electromagnetic 
Digitally  Controlled  Analyzer  Processor  and  Air  Force  Electronic 
Warfare  Evaluation  Simulator  facilities'  assets  to  Air  Combat 
Environment  Test  and  Evaluation  Facility  and  Benefield  Anechoic 
Facility  are  addressed  and  meet  the  Director's  approval  for 
compliance  with  Reliance  goals,  and 

2.  exercise  oversight  responsibilities  to  restrict  new  Air 
Force  investments  in  Real-time  Electromagnetic  Digitally 
Controlled  Analyzer  Processor  and  Air  Force  Electronic  Warfare 
Evaluation  Simulator  facilities  (beginning  with  Fiscal  Year 
1993  funds)  to  preclude  unwarranted  improvements  and  duplication 
until  the  Navy  Electronic  Warfare  Reliance  study  is  completed. 

MANAGEMENT  COMMENTS 

The  Director's  responses  concurred  with  the  intent  of  the  finding 
stating  that  the  disposition  of  the  Real-time  Digitally 
Controlled  Analyzer  and  Processor  (REDCAP)  and  the  Air  Force 
Electronic  Warfare  Evaluation  Simulator  (AFEWES) ,  and  the 
relationship  of  these  facilities  to  the  BAF  and  ACEFEF  was  under 
examination  by  an  EW  Reliance  study  team.  He  further  stated  that 
this  examination  may  only  need  refinement  to  resolve  disputes  in 
the  overall  hardware-in-the-loop  arena.  The  Director  proposed 
alternatives  to  the  draft  report  recommendations. 

AUDIT  RESPONSE  TO  MANAGEMENT  COMMENTS 

The  Director's  comments  are  responsive  and  the  recommendations 
B.l  and  B.2.  have  been  revised  to  reflect  this.  However,  the 
Director  will  have  to  refine  the  tasking  given  in  March  1992  to 
address  the  relocation  of  the  REDCAP  and  AFEWES  assets  to  ACETEF 
and  BAF. 
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APPENDIX  A:  PRIOR  AUDITS  AND  OTHER  REVIEWS 


DoDIG  Report  No.  88-201.  "Aircraft  Integrated  Test  Facilities. 11 
September  13.  1988. 

The  audit  focused  on  anechoic  chambers  used  for  integrated 
electronic  warfare  testing.  The  auditors  concluded  that  the  Navy 
and  Air  Force  were  planning  and  funding  integrated  test 
facilities  with  unnecessary  duplication  of  capabilities.  The 
report  recommended  not  building  the  large  chamber  at  Edwards  AFB 
and  building  a  large  chamber  at  Naval  Air  Test  Center.  The  Air 
Force  nonconcurred  and  obtained  Congressional  reprogramming 
authority  to  construct  the  large  chamber  at  Edwards  AFB  during 
the  resolution  process. 

DoD  Electronic  Warfare  Test  and  Evaluation  Investment  Strategy 
Panel  Report.  "Electronic  Warfare  Test  and  Evaluation  Investment 
Strategy  Phase  I  Final  Report."  March  8,  1991. 

The  objectives  of  the  panel  were  to  define  future  electronic 
warfare  test  and  evaluation  capabilities  to  support  the 
acquisition  of  major  weapon  systems  within  realistic  fiscal 
limits,  define  areas  of  responsibilities  among  the  Services,  and 
lay  out  an  investment  strategy  to  upgrade  and  develop  essential 
electronic  warfare  test  and  evaluation  resources.  The  panel 
recommended  expanding  capabilities  at  Edwards  AFB  and 
modernizing  ACETEF  while  not  building  a  large  chamber. 

Deputy  Director  Defense  Research  and  Engineering  (Test  and 
Evaluation)  "Study  of  Anechoic  Chambers  Used  to  Support  the  T&E 
of  Full  Scale  Systems.”  October  3,  1988. 

The  purpose  of  this  study  was  to  examine  the  utilization  and  the 
cost  effectiveness  of  anechoic  chambers  and  associated  simulation 
facilities  used  for  the  test  and  evaluation  of  full-scale  weapons 
systems  and  to  propose  OSD  guidelines  for  their  continuing 
development.  The  study  recommended  upgrading  ACETEF  to  a 
Category  I  facility  and  developing  the  large  chamber  at  Edwards 
AFB  to  a  Category  II  facility.  The  study  also  recommended  that  a 
tri-Service  team  oversee  joint  acquisition  and  development  of  all 
Category  I,  II,  and  III  facilities. 
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APPENDIX  Bj  CONGRESSIONAL  REQUEST 


Congress:  of  tfje  tHnttcb  Stated 

fflM&ittjjton,  SC  20513 


August  4,  1992 


Hr.  Derek  J.  Vander  Schaaf 
Deputy  Inspector  General 
Department  of  Defense 
400  Army-Navy  Drive 
Arlington,  Virginia  22202-2884 

Dear  Mr.  Vander  Schaaf,  '  , 

We  are  writing  to  request  your  review  of  a  report  that  was 
prepared  by  the  Institute  for  Defense  Analysis  comparing  the  Navy's  Air 
Combat  Environment  Test  and  Evaluation  Facility  (ACETEF)  and  the  Air 
Force's  Electronic  Combat  Integrated  Test.  We  have  reason  to  believe 
that  the  data  relied  upon  in  this  report  is  inaccurate  and,  therefore, 
the  conclusions  of  the  report  are  flawed. 

We  would  appreciate  if  you  could  review  the  data,  analysis  and 
conclusions  of  this  study  utilizing  the  knowledge  and  expertise  of  your 
Office  and  report  your  comments  to  us  by  August  31.  Since  this  issue 
is  a  matter  of  importance  in  two  committees  that  will  be  conferencing 
on  this  issue  in  early  September,  it  is  important  that  your  report  or 
briefing  be  received  by  August  31. 

The  IDA  report  also  appears  to  adopt  the  premise  relied  upon  by 
the  Air  Force  that  both  ground  testing  and  flight  testing  must  be  co¬ 
located.  The  Navy  does  not  agree  that  such  tests  must  be  co-located. 
Please  examine  the  success  of  both  philosophies.  We  would  be 
interested  in  your  opinion  on  whether  Navy's  testing  program  has  worked 
and  whether  it  could  work  for  Air  Force.  Please  also  examine  what 
impact  that  would  have  on  the  conclusions  reached  in  the  IDA  report. 

A  key  question  in  this  report  is  the  cost  of  deploying  the  F-22 
program  to  ACETEF.  On  page  52,  these  costs  are  estimated  to  be  $148 
million,  but  on  page  47,  the  deployment  costs  are  listed  at  $272 
million.  Are  these  costs  accurate?  Can  the  facilities  at  ECIT  as  they 
currently  exist  serve  as  the  System  Integration  Lab  (SIL)  for  the  F-22? 
If  not,  what  would  it  cost  to  provide  this  function?  Were  these  costs 
considered  in  the  report?  Does  the  SIL  for  the  F-22  need  to  be  co¬ 
located  with  ACETEF,  and  if  so  are  facilities  at  ACETEF  capable  of 
serving  this  function?  If  not,  what  would  the  projected  costs  be  for 
accomplishing  this  function? 
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APPENDIX  B:  CONGRESSIONAL  REQUEST  (cont'd) 


Hr:  Derek  Vender  Schaaf  ■  August  4,  1992 

Page  2 

This  report  also  seems  to  be  very  susceptible  to  changes  in  the 
capacity  requirements  of  the  various  services.  In  fact,  if  actual 
requirements  are  less,  the  report  concludes  that  in  certain 
circumstances,  Alternative  2,  building  the  large  chamber  at  Pax  River, 
would  be  the  most  effective  option.  Please  examine  the  capacity 
requirements  and  based  on  your  experience  include  what  you  believe  to 
be  the  most  accurate  estimates. 

In  your  1988  report  your  found  that  without  the  large  chamber,  it 
would  costs  $340  million  to  duplicate  capability  now  available  at  Pax 
at  the  ECIT  facility.  The  IDA  report  concludes  that  these  costs  are 
$168  million.  What  are  the  costs  to  the  best  of  your  information? 

Also  in  your  1988  report,  you  concluded  that  a  large  chamber 
should  not  be  constructed  at  Edwards,  and  that  it  made  more  sense  to 
construct  such  a  chamber  at  Patuxent.  The  issue  now  appears  to  be  even 
though  your  original  recommendation  was  ignored,  is  it  still  your 
opinion  that  the  cheapest,  fastest  and  lowest  risk  strategy  for 
accomplishing  the  goal  of  establishing  the  first  fully  integrated 
National  Asset  for  integrated  testing  is  to  complete  ACETEF? 

We  appreciate  your  attention  to  this  request  and  your  timely 
review  of  this  document. 
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APPENDIX  C;  INSTITUTE  FOR  DEFENSE  ANALYSES  REPORT  DEFICIENCIES 


Page  viii: 

Statement:  Four  alternatives  are  developed  by  IDA  to  satisfy  Navy 
and  Air  Force  capability  options.  Of  the  four. 

Alternative  2  builds  a  large  anechoic  chamber  at  ACETEF  and  would 
operate  at  2  shifts  a  day,  while  Alternative  3  develops  the 
ECIT  and  would  operate  at  2.5  shifts  per  day. 

Correction:  We  found  that  the  capacity  for  Alternative  2  was 

understated;  that  is,  it  should  also  show  an  operating  capacity 
of  2.5  shifts  per  chamber.  IDA  could  not  provide  us  with 
documentary  support  for  its  rationale  in  limiting  Alternative  2 
to  four  shifts  per  day.  The  significance  of  limiting  the  shifts 
to  two  is  to  show  a  significant  disproportionate  capacity 
capability  between  the  ACETEF  and  the  ECIT  that  favors  the  ECIT 
operation. 

Page  xiii: 

Statement:  "However,  developing  the  ECIT  capability  would  satisfy 
25%  more  requirements  than  building  an  LAC  at  ACETEF." 

Correction:  Capability  is  in  relation  to  the  number  of  shifts 
assigned  each  alternative,  thus  adding  a  fifth  shift  to  ACETEF  to 
equal  the  shifts  for  ECIT  would  eliminate  the  capacity 
difference. 

Page  8: 

Statement:  "Costs  already  incurred  for  existing  resources  (e.g., 
facilities,  equipment)  were  considered  to  be  sunk  costs  and, 
accordingly,  were  not  included  in  the  analysis." 

Correction:  The  Navy  has  invested  $249  million  in  ACETEF  for 

laboratories,  and  the  Air  Force  has  invested  $52  million  in  BAF 

for  a  large  chamber.  The  Air  Force's  proposed  $168  million 
investment  represents  a  duplication  of  ACETEF  capabilities,  as 
shown  on  page  49  of  the  IDA  report. 

Page  13: 

Statement:  "The  two  principal  facilities  under  review  in  this 
study  are  two  Category  II  facilities:..." 

Correction:  ACETEF  is  a  Category  II  facility  while  ECIT  is 

considered  a  Category  III  facility.  IDA  correctly  identified 
ECIT  as  a  Category  III  Facility  on  page  15. 

Page  20: 

Statement:  "Further,  the  size  of  the  (ACETEF)  chamber  would 

appear  to  limit  stimulation  methodology  to  signal  injection 
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APPENDIX  Cr  INSTITUTE  FOR  DEFENSE  ANALYSES  REPORT  DEFICIENCIES 
(cont'd) 


and/or  the  use  of  'antenna  hats.'  Free-space,  far-field 
radiation  is  not  possible." 

Corrections  Tests  requiring  free-space  have  been  accomplished  at 
ACETEF  and  can  be  performed  in  the  future  if  the  customer  so 
requests.  Further,  the  Navy's  proposed  large  chamber  could  be 
built  to  meet  all  national  needs.  IDA  informed  us  that  its 
statement  was  based  on  discussions  with  the  Air  Force. 

Page  26: 

Statement:  "In  addition,  the  current  ACETEF  closed-loop 

capability  does  not  cover  all  Air  Force  threat  requirements." 

Correction:  This  statement  is  correct  only  because  the  threat 
simulators  have  not  been  developed  by  DoD's  responsible  agency. 

Statement:  "Finally,  the  closed-loop  capability  available  at 
ACETEF  is  oriented  toward  sea-based  threats,  and  is  of  less  value 
in  measuring  the  performance  of  systems  under  test  against  land- 
based  threats." 

Correction:  This  difference  between  the  types  of  threats  is 
negligible  according  to  the  OSD  program  office  responsible  for 
threat  simulator  development. 

Page  28,  32,  49 

Statement:  "Although  approved  funding  was  $60  million,  the 
estimated  cost  is  about  $72  million."  (Pertaining  to  generic 
capability) 

Statement:  "The  above  capabilities  (generic)  are  all  within  the 

$60  million  proposed  program." 

Statement:  "The  generic  upgrade  program  is  $71.9  million." 

Correction:  The  above  statements  contain  a  contradiction  in 
defining  the  cost  for  generic  capabilities. 

Page  69: 

Statement:  "The  Chesapeake  Test  Range  at  Patuxent  Naval  Air 
Station  is  considered  to  be  too  small  and  congested  for 
additional  high-performance  AIR  FORCE  flight  testing." 

"The  cost  of  deploying  the  F-22  to  ACETEF  for  electronic 
combat/avionics  ground  testing  offsets  the  cost  of  developing  an 
expanded  ECIT  at  Edwards  AFB . " 
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(cont'd) 


Correction:  IDA  could  not  substantiate  this  opinion. 

Page  70: 

statement:  "The  IDA  analysis  shows  that  building  BAF  rather  than 
a  large  chamber  at  ACETEF  is  the  most  cost-effective,  lowest  risk 
alternative.  While  both  options  would  add  the  capability  to  test 
large  aircraft,  the  ECIT  at  Edwards  would  provide  the  most 
flexibility  to  adjust  to  an  uncertain  workload  and  would  add  more 
total  capacity  at  less  cost  per  unit.  It  supports  the  current 
AIR  FORCE  philosophy  of  collocating  ground  and  flight  testing, 
and  provides  a  needed  additional  source  of  test  capability." 


Correction:  IDA'S  analysis  was  flawed.  The  correct  data  shows 
that  Alternative  2  is  the  most  cost  effective. 

Page  D-5: 

Statement:  "The  estimate  of  the  total  cost  through  FY  2000  in 
this  scenario  is  $143  million  constant  FY  1992  budget  dollars, 
roughly  half  the  SYSTEMS  PROGRAM  OFFICE  estimate." 

Correction:  Table  D-3  on  page  D-6  indicates  a  total  of 

$148.3  million,  the  correct  amount. 


! 
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APPENDIX  D 


PROGRAMS  REVIEWED  FOR  WORKLOAD  VALIDATION 


NAVY 


PROGRAM 


ASEMICAP4 

ASPJ5 

F/A-18 

AH-1W 

Unmanned  Aerial  Vehicle 

H-2  &  H-60  (ASW  HELO)6 

A-6E 

EA-6B 

F-14 

EP-3 

V— 22 

SEEK  SPARTAN 

H-53 

E-2C 

E-6A 

P-7 

ES-3A 

P-3 


TOTAL 


Fiscal 

Years 

1994  - 

1996 

(Workload  in 

Weeks  < 

(Days) 1 

FORECAST^ 

CONFIRMED 

DAYS 

WEEKS""  DAYS 

WEEKS 

110 

7.3 

110 

7.3 

264 

17.6 

14 

.9 

120 

8.0 

90 

6.0 

35 

2.3 

35 

2.3 

120 

8.0 

-0- 

-0- 

50 

3.3 

-0- 

-0- 

50 

3.3 

-0- 

-0- 

70 

4.6 

70 

4.6 

90 

6.0 

-0- 

-0- 

60 

4.0 

150 

10.0 

198 

13.2 

66 

4.4 

55 

3.6 

-0- 

-0- 

20 

1.3 

-0- 

-0- 

40 

2.6 

-0- 

-0- 

35 

2.3 

-0- 

-0- 

60 

4.0 

-0- 

-0- 

35 

2.3 

-0- 

-o- 

50 

3.3 

-0- 

-0- 

1462 

97.0 

535 

35.5 

*  We  reviewed  82  percent  of  the  total  forecasted  workload  of 
1792  days. 


**  The  Navy  provided  workload  was  in  days  over  a  three-year 
period  that  was  converted  to  average  weeks  per  year.  The  average 
weeks  per  year  was  arrived  at  by  dividing  the  total  days  by  three 
and  then  by  five.  For  example,  ASEMICAP: 

110  days  divided  by  3  years  =  36.7  days  divided  by  5  days  = 
7.3  weeks  per  year. 


Audit  confirmed  37  percent  of  forecast  workload  (535/1462) . 


4  Air  Systems  Electromagnetic  Interference  Corrective  Action 
Program 

®  Advanced  Self  Protection  Jammer 

6  Anti-Submarine  Warfare  Helicopter 
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APPENDIX  D:  PROGRAMS  REVIEWED  FOR  WORKLOAD  VALIDATION  (cont'd) 


AIR  FORCE 


PROGRAM 


Fiscal  Years  1995  -  2005 
(Workload  in  Weeks) 

FORECAST*  CONFIRMED 


MC-103H 

AC  130U 

CV-22 

EC-130 

F-16 

F-22 

E-3A 

Joint  STARS7 
EF-111 
F-lll 
F-15 


12 

6 

12 

20 

10 

10 

5 

5 

11 

9 

11 


6 

4 

3 

6 

10 

10 

2 

0 

0 

0 

0 


TOTAL 


AAA  AA 


*  We  reviewed  87  percent  of  the  total  forecasted  workload  of  127 
weeks . 


Audit  confirmed  37  percent  of  forecast  workload  (41/111) . 


7  Joint  Surveillance  Target  Attack  Radar  System 
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APPENDIX  E:  PROPOSED  BENEFIELD  ANECHOIC  FACILITY  CAPABILITY 
COMPARED  TO  AIR  COMBAT  ENVIRONMENT  TEST  AND 
EVALUATION  FACILITY 


ELECTRONIC  COMBAT  INTEGRATED  TEST  PROGRAM 

EQUALITY  * 


ECU  VISION 


ACETEF 


*  Source:  Air  Force  Flight  Test  Center  briefing  given 
auditors  on  February  26,  1992. 


An  enlargement  of  the  ECIT  and  ACETEF  capabilities  are  on 
the  following  pages. 
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APPENDIX  E:  PROPOSED  BENEFIELD  ANECHOIC  FACILITY  CAPABILITY 
COMPARED  TO  AIR  COMBAT  ENVIRONMENT  TEST  AND 
EVALUATION  FACILITY  (cont'd) 


Benefield  Anechoic  Facility 
Proposed  Capabilities 


MULTI-SPECTRAL 

WTERFACILtTY 

CORRELATION 

COMM 

EOT  PROGRAM 


CUSTOMER  SPECIFIC 
CAPABILITY 


VISION 


2  3 

C  /C  I. . .Command  and  Control /Command,  Control,  Communications, 
and  Intelligence 

EO/IR. . . .Electro-Optical  Infrared 
RF . Radio  Frequency 

RCS  R&M. .Radar  Cross  Section  Repair  and  Maintenance 
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APPENDIX  E:  PROPOSED  BENEFIELD  ANECHOIC  FACILITY  CAPABILITY 
COMPARED  TO  AIR  COMBAT  ENVIRONMENT  TEST  AND 
EVALUATION  FACILITY  (cont'd) 


Air  combat  Environment  Test  and  Evaluation  Facility 
Current  and  Proposed  Capabilities 


ASEF .... Air  Systems  Evaluation  Facility 

CNI . Communications,  Navigation,  Identification 

C2 . Command  and  Control 

E3TL. .. .Electromagnetic  Environment  Effects  Test  Lab 
EMEGS. . .Electromagnetic  Environment  Generating  System 
EWISTL. .Electromagnetic  Warfare  Integrated  Systems  Test 
Laboratory 

TASTEF. .Tactical  Avionics  and  Software  Test  and  Evaluation 
Facility 
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APPENDIX  Ft  PROPOSED  BENEFIELD  ANBCHOIC  FACILITY  FUNCTIONS 
COMPARED  TO  AIR  COMBAT  ENVIRONMENT  TE8T  AND 
EVALUATION  FACILITY  LABORATORIES 


DISTRIBUTION  OF  ECIT  BLDG  BLOCK  FUNCTIONS  ACROSS  ACETEF  LABS* 


TASK  PE9CWPHON:  Tbte  iwiWKjigjn  mponw  la  ■  requ»»t  trwn  Mr.  Stw 

lo  tfc»  ACETEF  ^«flonWhc»rfa>pr<)vkl»d. _ Hi _ 


C2/C3I . Command  and  Control /Command,  Control 

Communications,  and  Intelligence 
EO/IR . Electro-optical/infrared 

RCS  R&M.... Radar  Cross  Section  Repair  and  Maintenance 
RF . Radio  Frequency 
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APPENDIX  G:  COST  ESTIMATES  FOR  BENEFIELD  ANECHOIC  FACILITY 


ELECTRONIC  COMBAT  INTEGRATED  TEST  PROGRAM 

FUNDS  REQUIRED 


rJVRS;,; 

FY91 

FY92  FY93 

FY94 

FY9S 

BB 

w 

jpg 

1011 

■■mi 

BaB 

fiililfiSi 

r  generic' .  1 

••2;  4^- 

AM 

aBB 

Mipii 

■ 

11K 

25.0 

65.8 

;|  -  14.0 

Ecif  pop  ; :f>] f- 

’2  J 

11 

.26$.: 
:v*s  Vi's  ' 

f|SU 

23.9 

■w^ 

:  kf  .  i 

^iso.o:y 

-SHORTFALL  FOR  ill 

THE  POR  '  |;  |  } 

ADDITIONAL 

.^shortfall fftft  i 
FdRiTHE  vision. 

S?:  /x\ • 

mm 

mm 

g 

g 

ill 

isi 

1 

•:;.t||84,5. 

■  h?  '>#*'  %  *  ' 

PPpm8 

*  $1.5M  OF  AFFTC  DOA  TOTAL  ECIT  ESTIMATE  398.1 


DOA 

PDP 


Direct  Obligation  Authority 
Program  Decision  Package 


APPENDIX  Gt  COST  ESTIMATES  FOR  BENEFIELD  ANECHOIC  FACILITY 
(cont'd) 


ECU  Investment  Costs 
(Constant  FY1992  Dollars  in  Millions) 


Equivalent 

ACETEF 

Capability 

Future  Costs 

EOT 

Generic  (Facility  Infrastructure) 

Anechoic  chamber  cluster 

EWISTL 

28.0 

Management,  control 

OCC 

10.5 

Other 

Multiple 

14.8 

Program  management 

Multiple 

186 

Total  generic  program 

71.9 

Full  Function  Category  2 ISTF 

Building  construction  (MILCON) 

Aircrew  Systems  Evaluation  Facility 

13.3 

Lab  construction  (RDT&E) 

ASL 

MFS  cluster 

72.8 

CNI  cluster 

MFS+ASEF 

17.2 

EiectrtHDpdcal/Infrared  duster 

CNI 

20.8 

RF/Electronic  warfare  cluster 

OSL 

Management  and  control 

'  Multiple 

1.9 

Adjustments 

OCC 

Double  counting  of  equipment  interfaces 

-14.8 

Anticipated  price  reduction* 

Total  long-term  program 

96.5 

Total  generic  plus  long-term  programs 

168.4 

*  15*  of  historical  coat  of  EWISTL.  MFS,  ASL.  OCC.  OSL.  and  CNL 


ASEF . Aircrew  Systems  Evaluation  Facility 

CNI . Communication,  Navigation,  Identification 

EWISTL . Electronic  Warfare  Integrated  Systems  Test  Laboratory 

MFS. ...... .Manned  Flight  Simulator 

MILCON . Mil itary  Construction 

OCC . Operations  and  Control  Center 

OSL . Offensive  Sensors  Laboratory 
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APPENDIX  G:  COST  ESTIMATES  FOR  BENEFIELD  ANECBOIC  FACILITY 

(cont'd) 


ECIT  ESTIMATED  INVESTMENT  BY  BUILDING  BLOCKS  ($K-FY92) 


BB# 

Building  Block  Description 

BAF  Batalina 

F-16  Upgrades 

■BK&9B 

Facllttly  Upgrades 

Customer  Specific 
Upgrades 

0 

Facilities* 

52000.0 

25000.0 

1 

Intrafacility  Comm 

Included  in  Facilities 

6619.0 

2 

Test  Direction  &  Conduct 

6300.0 

sg 

Timing  &  Control 

8630.0 

,  ! 

n 

Data  Collection  8  Analysis 

Included  in  Facilities 

1867.0 

6300.0 

n 

Engineering  Support 

4950.0 

m 

Performance  Monitoring 

Included  in  Facilities 

550.0 

B 

Test  Item  Support 

Included  in  Facilities 

1249.0 

2750.0 

B 

Fundamental  RF  Threats 

Included  In  Facilities 

4407.0 

12950.0 

2880.0 

B 

High  Density  RF  Background 

1500.0 

500.0 

m 

C2/C3I  Modeling 

■ 

2800.0 

3600.0 

nr 

Customer  Plugins 

Not  an  ECIT  Cost 

ra 

Specialized  Instruments 

6100.0 

m 

Customer  Comm 

360.0 

m 

RCSR&M 

2000.0 

m 

EO/IR  Target  Generators 

' 

7500.0 

ra 

RF  Target  Generators 

19800.0 

nr 

Phase  Measurement 

16OQ0.0 

na 

Multi-Spectral  Correlation 

6300.C 

Interfacility  Comm 

Not  an  ECU  Cost 

Program  Office* 

386.0 

5538.0 

28B0.C 

21 

Engineering  Support* 

300.0 

13200.0 

5760.C 

Total 

52000.0 

8209.0 

72087.0 

i  25000.0 

1  73680.0 

*  Not  included  as  a  block  on 
the  budding  block  chart. 

iPPPff— Ml 

C2/C3I . Command  and  Control/Command,  Control,  Communications, 

and  Intelligence 

EO/IR . Electro-optical/infrared 

RF . Radio  Frequency 


41 


This  ,f)age  was  left  out  of  original  document 


<-12. 


APPENDIX  Hi  SUMMARY  OF  POTENTIAL  BENEFITS  RESULTING  FROM  AUDIT 


Recommendation 
Reference _ 

A.  1 . 


A. 2. 


B.l. 


Description  of  Benefit 

Economy  and  Efficiency. 
Correction  of  data  upon 
which  decisions  are 
made. 


Economy  and  Efficiency. 
Explore  alternatives 
discussed  in  Finding  B 
prior  to  making  further 
investments . 


Economy  and  Efficiency. 
Reduce  expenditure  for 
test  assets  until 
incorporation  of 
Reliance  Study. 


Economy  and  Efficiency. 
Provide  oversight  in 
selected  Air  Force 
test  facilities. 


Amount  and/or 
Type  of  Benefit 

Nonmonetary. 


Nonmonetary. 


Funds  Put  to 
Better  Use. 

$91  million  of 
RDT&E  funds  over 
Future  Years 
Defense  Plan. 


Nonmonetary . 
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APPENDIX  It  GLOSSARY 


Anechoic  chamber.  An  enclosure  with  external  walls  of  a  RF 
shielding  material  and  internal  walls  lined  with  material  which 
attenuates  (absorbs)  electromagnetic  energy.  The  RF  shielding 
material  isolates  the  chamber  interior  from  external  magnetic  and 
radio-wave  interferences  and  also  serves  to  contain  internally 
generated  radio-wave  signals  within  the  interior  of  the  chamber. 
The  internal  lining  attenuates  radio  waves  striking  the  chamber 
walls  and  thus  approximates  a  "free  space"  electromagnetic  energy 
environment,  such  as  that  surrounding  an  aircraft  in  flight. 

Avionics.  Electronic  instrumentation  for  controlling  aircraft 
and  weapon  systems. 

Closed-Loop  Testing.  A  form  of  electronic  combat  testing  in 
which  both  the  friendly  and  threat  systems  react  to  each  other's 
actions.  For  example,  in  a  test  of  a  friendly  jammer  against  a 
threat  missile  radar,  the  friendly  system  receives  and  identifies 
the  missile  radar  emissions  and  begins  jamming.  This,  in  turn, 
is  detected  by  the  missile  radar  causing  it  to  initiate  measures 
to  minimize  any  detrimental  effects  on  its  own  performance. 

Electromagnetic  compatibility.  The  capability  of  electrical  and 
electronic  systems,  equipment,  and  devices  to  operate  in  their 
intended  electromagnetic  environment  within  a  defined  margin  of 
safety  and  at  design  levels  of  performance  without  suffering  or 
causing  unacceptable  degradation  as  a  result  of  electromagnetic 
interference . 

Electromagnetic  Environmental  Effects.  The  impact  of  the 
electromagnetic  environment  upon  the  operational  capability  of 
military  forces,  equipment,  systems,  and  platforms.  It 
encompasses  all  electromagnetic  disciplines,  including 
electromagnetic  compatibility /interference;  electromagnetic 
vulnerability;  electromagnetic  pulse;  electronic  counter-counter¬ 
measures;  hazards  of  electromagnetic  radiation  to  personnel, 
ordinance,  and  volatile  materials;  and  effects  of  natural 
phenomena,  such  as  lightning. 

Electromagnetic  Interference.  Any  electromagnetic  disturbance, 
whether  intentional  or  not,  that  interrupts,  obstructs,  or 
otherwise  degrades  or  limits  the  effective  performance  of 
electronic  or  electrical  equipment. 

Electronic  Combat.  Action  taken  in  support  of  military 
operations  against  the  enemy's  electromagnetic  capabilities. 
Electronic  combat  includes  electronic  warfare;  elements  of 
command,  control,  and  communications  countermeasures;  and 
suppression  of  enemy  air  defenses. 
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APPENDIX  I;  GLOSSARY  (cont'd) 


Electronic  Combat  Integrated  Test  Facility.  An  enclosed,  secure 
facility  for  the  test  and  evaluation  of  electronic  systems  on 
aircraft  and  missiles.  It  is  an  anechoic  chamber  with 
instrumentation  and  laboratories  that  simulates  the  environment 
in  which  the  test  article  operates. 

Electronic  countermeasures.  The  area  of  electronic  warfare 
involving  actions  taken  to  prevent  or  reduce  the  enemy's 
effective  use  of  the  electromagnetic  spectrum.  It  includes 
electronic  jamming  and  electronic  deception. 

Electronic  Warfare.  Military  action  involving  the  use  of 
electromagnetic  energy  to  determine,  exploit,  reduce,  or  prevent 
hostile  use  of  the  electromagnetic  spectrum  and  action  which 
retains  friendly  use  of  the  electromagnetic  spectrum. 

Hardware-in-the-Loop  Testing.  Electronic  combat  testing  in  which 
the  test  system  hardware  is  tested  and  evaluated  against  closed- 
loop  threat  simulations. 

Installed  Test  Facilities.  Test  resources  which  provide  the 
capability  to  test  EC  systems  while  installed  on,  or  integrated 
with,  host  platforms. 

Man-in-the-Loop  Testing.  Electronic  combat  test  simulations 
using  manned  equipment  in  which  the  human  interaction  plays  a 
role  in  the  test  scenario. 

Many-on-Many  Testing.  The  simulation  of  a  major  war-time  battle 
with  several  types  and  numbers  of  friendly  (blue)  forces  engaged 
against  several  types  and  numbers  of  enemy  (red)  forces. 

Multi-Spectral  Testing.  Electronic  combat  testing  that  evaluates 
weapons  that  use  more  than  one  area  of  the  electromagnetic 
spectrum.  Examples  are  radio  (radar) ,  infrared,  ultraviolet,  and 
millimeter  waves. 

Open-Loop  Testing.  Electronic  combat  testing  involving  scenarios 
in  which  only  one  system  is  allowed  to  interact  with  another's 
actions.  For  example,  in  the  test  of  a  jammer  against  a  missile, 
emissions  of  the  missile  are  received  by  the  jammer,  which  begins 
jamming.  The  missile  simulations  are  not  allowed  to  receive  and 
react  to  the  jammer's  signals. 

Radio  Frequency.  In  electronic  combat  this  term  applies  to 
avionics  and  weapons  systems  that  operate  on  the  radio  wave 
section  of  the  electromagnetic  spectrum.  This  includes  radar  and 
radio  voice  systems. 

Reprogramming  Action.  In  Government  budgeting  this  refers  to  the 
transfer  of  funds  appropriated  for  a  certain  purpose  to  another 
use.  It  requires  the  concurrence  of  Congress. 
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APPENDIX  J:  ACTIVITIES  VISITED  OR  CONTACTED 


Office  of  the  Secretary  of  Defense 

Under  Secretary  of  Defense  for  Acquisition,  Washington,  DC 
Director,  Test  and  Evaluation,  Washington,  DC 

Department  of  the  Army 

Assistant  Secretary  of  the  Army  (Financial  Management) , 
Washington,  DC 

Test  and  Evaluation  Command,  Aberdeen  Proving  Ground,  MD 
Electronic  Proving  Ground,  Fort  Huachucha,  AZ 

Department  of  the  Naw 

Assistant  Secretary  of  the  Navy  (Financial  Management) , 
Washington,  DC 

Director  of  Navy  Test  and  Evaluation  and  Technology  Requirements, 
Washington,  DC 

Naval  Air  Systems  Command,  Arlington,  VA 

Naval  Air  Warfare  Center,  Aircraft  Division,  Patuxent  River,  MD 
Naval  Air  Warfare  Station,  China  Lake,  CA 
Naval  Air  Warfare  Station,  Point  Mugu,  CA 


Department  of  the  Air  Force 

Assistant  Secretary  of  the  Air  Force  (Acquisition) , 
Washington,  DC 

Assistant  Secretary  of  the  Air  Force  (Financial  Management 
and  Comptroller) ,  Washington,  DC 
Director,  Air  Force  Test  and  Evaluation,  Washington,  DC 
Air  Force  Materiel  Command,  Wright-Patterson  AFB,  OH 
Air  Warfare  Center,  Kirtland  AFB,  NM 
Warner  Robins  Air  Logistics  Center,  Robins  AFB,  GA 
Sacramento  Air  Logistics  Center,  McClelland  AFB,  CA 
Air  Force  Developmental  Test  Center,  Eglin  AFB,  FL 
Air  Force  Flight  Test  Center,  Edwards  AFB,  CA 
Joint  STARS  System  Program  Office,  Hanscom  AFB,  MA 

Non-Government  Activities 


Calspan  Corporation,  Buffalo,  NY 

Real-Time  Electromagnetic  Digitally  Controlled  Analyzer  and 
Processor,  Buffalo,  NY 
General  Dynamics,  Ft.  Worth,  TX 

Air  Force  Electronic  Warfare  Evaluation  Simulator, 

Fort  Worth,  TX 

Grumman  Corporation,  Melbourne,  FL 
Institute  for  Defense  Analyses,  Alexandria,  VA 
McDonnell  Douglas  Corporation,  St.  Louis,  MO 
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APPENDIX  Ki  REPORT  DISTRIBUTION 


Office  of  the  Secretary  of  Defense 

Under  Secretary  of  Defense  for  Acquisition 
Director,  Test  and  Evaluation 

Department  of  the  Naw 

Secretary  of  the  Navy 

Assistant  Secretary  of  the  Navy  (Financial  Management) 

Assistant  Secretary  of  the  Navy  (Research,  Development,  and 
Acquisition) 

Comptroller  of  the  Navy 
Naval  Air  Systems  Command 

Director  of  Navy  Test  and  Evaluation  and  Technology  Requirements 
Department  of  the  Air  Force 
Secretary  of  the  Air  Force 

Assistant  Secretary  of  the  Air  Force  (Acquisition) 

Assistant  Secretary  of  the  Air  Force  (Financial  Management 
and  Comptroller) 

Director,  Air  Force  Test  and  Evaluation 
Non-DoD  Federal  Organizations 
Office  of  Management  and  Budget 

U.  S.  General  Accounting  Office,  NSIAD  Technical  Information 
Center 

Congressional  Committees: 

Senate  Subcommittee  on  Defense,  Committee  on  Appropriations 
Senate  Committee  on  Armed  Services 
Senate  Committee  on  Governmental  Affairs 

Ranking  Minority  Member,  Senate  Committee  on  Appropriations 
House  Committee  on  Appropriations 

House  Subcommittee  on  Defense,  Committee  on  Appropriations 
Ranking  Minority  Member,  House  Committee  on  Appropriations 
House  Committee  on  Armed  Services 
House  Committee  on  Government  Operations 
House  Subcommittee  on  Legislation  and  National  Security, 
Committee  on  Government  Operations 
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PART  IV-  MANAGEMENT  COMMENTS 


Office  of  the  Under  Secretary  of  Defense  for  Acquisition 
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Office  of  the  Under  Secretary  of  Defense 
for  Acquisition  Comments 


Final  Report] 
Reference 
Page  No. 


OFFICE  OF  THE  UNDER  SECRETARY  OF  DEFENSE 
WASHINGTON,  OC  *0101 


ACQUISITION 


1*  SEP 


These 
comments 
are  not 
included  ini 
Part  IV  but  I 
are  avail¬ 
able  upon 
request. 


4,  para  2 


MEMORANDUM  FOR  DIRECTOR,  ACQUISITION  MANAGEMENT  DIRECTORATE, 
DoD(XG) 

SUBJECT t  Draft  Audit  Report  on  Electronic  Combat  Integrated 
Test  Facilities  (Project  No.  2AB-0025) 

Z  have  reviewed  the  subject  report  and  Service  comments 
(attached)  that  dispute  your  findings  and  recommendations,  and  I 
do  not  concur  in  your  recommendations. 

Your  audit  is  based  on  assumptions  relating  to  current  or 
past  generation  avionics  technology  systems,  in  particular 
electronic  combat  (EC)  subsystems.  The  new  generation  of 
integrated  avionics  systems  requires  a  new  test  methodology  and 
associated  capabilities.  The  F-22  is  not  simply  the  driver  of 
the  Institute  for  Defense  Analyses  (IDA)  report  or  your  audit. 
Rather,  it  is  the  forerunner  pf  Integrated  systems  challenges  to 
come.  Future  avionics  systems  will  generate,  process  and 
integrate  data  at  rates  that  are  orders  of  magnitudes  greater 
than  today's  federated  systems.  Today's  test  capabilities  are 
inadequate  to  test  these  systems  efficiently,*  and  sufficient  data 
can  not  possibly  be  generated  through  field  testing  alone. 
Consequently,  a  new  approach  is  needed.  Hence,  the  advent  of 
integrated  systems  test  facilities  (ISTFs)  or  ECITs,  as  referred 
to  in  your  audit,  with  collocated  field  test  capabilities.  This 
is  the  direction  of  the  future  for  the  Department  from  both  a 
cost/ efficiency  and  effectiveness  standpoint.  Xn  the  aircraft 
arena,  future  systems  will  need  such  support/test  capabilities 
and,  wherever  feasible,  we  should  strive  for  collocation  with 
field  test  capabilities. 

Sufficient  questions  have  been  raised  with  regard  to  your 
workload  validation  methodology  and  ACETEF  shift  assumptions  to 
convince  me  that  neither  the  ECXT  facility  design  nor  the  ACETEF 
development  activities  should  be  halted.  As  indicated  in  the 
attached  Service  comments.  Test  and  Evaluation  Master  Plans 
(TEXPs)  and  program  manager  budget  documentation  are  not 
dependable  sources  for  long-term  test  resource  planning  or 
requirements  validation.  Each  Service  has  revalidated  sufficient 
workload  to  justify  Integrated  System  Test  Facilities  at  each  of 
the  (two) principal  Service  aircraft  developmental  test  sites, 
particularly  in  view  of  next-generation  integrated  systems. 
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Office  of  the  Under  Secretary  of  Defense  for  Acquisition  Comments  (continued) 


Final  Report 
Reference 
Page  No. 


6,  para  1 


To  overcome  the  limitations  of  the  TEMP,  we  have  encouraged 
individual  and  nulti-Service,  ayatematic  approaches  to  long  range 
{5  y ear*  ♦)  t*st  resource  planning*  Each  Service  now  has  suen  a 
system  and  all  are  working  together  (since  1988)  through  the 
Joint  Commanders  Group  (Test  and  Evaluation)  to  conduct  joint 
reviews.  Consequently,  I  have  confidence  that  their  workload 
estimates  are  more  representative  than  yours. 

In  addition,  in  response  to  DMRD  922,  we  have  gone  e  step 
further  end  installed  e  Reliance  approach  to  test  resource 
planning.  Reliance  provides  for  the  identification  of  Single- 
Service  resource  planners  for  the  Department  and  greater 

terdependence  among  the  Services.  This  process,  oven  in  its 
e  \y  stages,  has  borne  out  the  need  for  the  two  primary 
facilities  that  are  the  focus  of  Part  II.  A.  of  your  audit. 

One  other  key  assertion  in  your  findings  must  be  challenged 
-  the  facility  shift (s)  assumption.  We  ere  not  aware  of  any 
analysis  that  would  support  five  shifts  et  the  Air  Combat 
Environment  Test  and  Evaluation  Facility  (ACETEF)  or  its 
associated  chamber.  To  the  contrary,  the  Navy  maintains  that 
even  four  shifts  would  require  the  right  combination  of  customer 
needs  and  optimal  scheduling  of  both  people  and  equipment.  The 
number  of  shifts  available  at  ACETEF  is  not  simply  a  matter  of 
summing  potential  shift  work  at  two  separate  locations  -  ECIT  and 
ACETEF. 

The  disposition  of  the  Real-Time  Digitally  Controlled 
Analyzer  and  Processor  (REDCAP)  and  Air  Force  Electronic  warfare 
Evaluation  Simulator  (AFEWES) ,  end  the  relationship  of  these 
facilities  to  the  Electronic  Combat  Integrated  Test  (ECIT) 
facility  and  the  Air  Combat  Environment  Test  and  Evaluation 
Facility  (ACETEF)  are  under  examination.  I  directed  a  study  last 
March  (Tab  B)  in  response  to  FY  92  Authorization  Conference 
tasking.  That  study  addresses  this  area  among  other  electronic 
combat  test  capabilities  and  may  only  need  refinement  to  resolve 
disputes  in  the  overall  hardware-in-the-loop  arena. 

My  proposed  changes  to  your  recommendations,  as  discussed 
with  your  auditors  ere  provided  et  Tab  A.  Service  comments  are 
provided  et  Tab  C  for  your  information  end  consideration. 


Charles  E.  Xdolz 
Director 
Test  end  Evaluation 


Attachments 
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OFFICE  OF  THE  INSPECTOR  GENERAL 


PROJECT  NO.  2AB-0025 
1992 


September  1, 


PART  II  -  FINDINGS  AND  RECOMMENDATIONS 
A.  Deficient  Cost  Analysis 


NONCONCUR 


I  propose  that  this  recommendation  be  changed  to  read: 


11,  para  2 


Office  of  the  Under  Secretary  of  Defense  for^cq^ 
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18,  para  4 


19,  para  1 


PART  II  -  FINDINGS  AND  RECOMMENDATIONS 
B.  Consolidation  of  Facilities 


RECOMMENDATIONS  FOR  CORRECTIVE  ACTION 


NONCONCUR 

I  propose  that  this  recommendation  be  changed  to  read: 

We  recommend  that  the  Director.  Test  and  Evaluations 

1*.  direct  the  EW  Reliance  Lead  to  accelerate  and  refine 
the  electronic  combat  test  clan  study  effort  cited  above,  as 
necessary,  to  ensure  that  the  advisability,,  cost,  liabilities, 
benefits  and  schedule  for  the  transfer  of  assets  such  as  REDCAP 
and  AFEWES  are  evaluated  and  meet  the  Director's  approval  for 

c.opp1  lance  with  Reliance  gcale.. 

2jl  exercise  oversight  responsibilities  to.  restrict  new  Air 
Force  investments  in  the  REDCAP  facility  {beginning  with  FY  93 
fundsl-to .preclude  .unwarranted.  improvements  and  duplication  until 
the  electronic  combat,  test  plan  study  effort  addresses  this 
Issue,. 
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milestone  plan  and  to  davelop  (in  concert  with  the  other 
Services)  a  DoD  EC  test  capability  investment  master  plan 
responsive  to  the  concerns  of  the  Authorisations  Conference 
language.  That  milestone  plan  should  toe  presented  at  the 
April  3,  1992,  DTESG  meeting. 

The  Navy  will  use  any  alternatives  specified  toy  the  T&E 
principals  at  the  DTESG  meeting,  the  Electronic  Warfare  Test  and 
Evaluation  Investment  Strategy  Capstone  Report  and  such  other 
sources  as  they  may  deem  appropriate  to  develop  the 
aforementioned  EC  test  capability  investment  master  plan. 

Results  of  this  effort  will  toe  briefed  through  the  joint 
Commanders  Group  (Test  and  Evaluation)  and  to  the  DTESG  to 
arrive  coincident  with  the  FY  94  Budget  Estimate  Submission 
(September  15,  1992),  so  that  they  may  be  Incorporated  with 
Program  Budget  Decisions  made  at  that  time. 


Charles  e.  Adolph  / 
Deputy  Director  U 
(Test  and  Evaluation) 


‘  Attachment 


DUSD(A) 

OSD(C) 
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OFFICE  OF  THE  DIRECTOR  OF  * 
DEFENSE  RESEARCH  AND  ENGINEERING 

WASHINGTON.  DC  *0*01 


FEB  101992 


MEMORANDUM  TOR  TEST  AND  EVALUATION  RESOURCE  COMMITTEE  (TERC) 

SUBJECT:  Authorisation  Conference  Report  Tasking  to  Davalop  an 
Electronic  Coabat  (EC)  Tast  Capability  Master  Rian 


The  "tiger"  team  set  up,  as  agreed  to  at  tha  Decaaber  16, 
1991,  DTESG  seating,  baa  sat  tvioe  to  address  the  subject 
tasking. 

Me  held  our  initial  organizational  seating  on  Deeesber  30, 
1991,  to  eonfirs  the  fora  and  content  of  the  report  (outlined  at 
the  DTESG  seating)  due  to  the  Congress  on  May  1,  1993.  Ns  agreed 
the  EW  Reliance  report  (edited)  and  the  signed  EH  Reliance  MOA, 
along  with  a  transslttal  sesorandus  from  the  Secretary,  vould 
fora  the  basis  for  tha  Kay  1,  1992,  report  to  the  Congress.  In 
addition,  teas  seabsrs  vers  asked  to  develop  a  Milestone  schedule 
to  achieve  coordination  of  the  EH  Reliance  report  and  MOA  through 
the  "TEE  Principals"  by  March  4,  1992. 

He  held  our  second  seating  at  IDA  on  Decaaber  31,  1991,  to 
receive  reports  on  Service  Milestone  schedules  for  EH  Rsliance 
coordination.  He  agreed  that  March  4,  1992,  coordination  vas 
achievable.  Although  the  Navy  vas  not  rapressntsd  at  the 
aeeting,  I  vas  advised  separately  that  they  vould  have  no  problem 
seating  the  March  suspense. 

The  Authorizations  Conference  Report  also  contains  language 
requiring  an  "overall  electronic  coabat  test  strategy"  that 
should  be  expanded  to  include  all  "DoD  electronic  coabat 
development  and  testing  facilities"  vith  "special  attention  to 
duplication  of  facilities  and  opportunities  to  consolidate  ... 
facilities  vithin  each  component."  Me  agreed  that  the  desired 
approach  to  this  aspect  of  the  tasking  (again  as  outlined  in  the 
DTESG  seating  cited  ebove)  vas  to  address  such  consolidation 
issues  during  the  noraal  course  of  the  ROM/President's  Budget 
development  and  review  process. 

However,  the  teas  vas  unanimous  in  their  position  that  ve 
could  wait  for  either  the  EH  Reliance  report  to  be 
coordinated  (March  4)  or  the  ROM  submission  (April  11  to  begin 
developing  costs,  savings,  advantages  and  disadvantages,  ate.,  to 
specific  consolidation  alternatives  or  the  formulation  of  other 
consolidation  options  and  have  any  hope  of  seating  nosinal  budget 
review  tine-lines.  Accordingly,  tha  teas  recommended  that 
DDDRE(TtE)  provide  tasking  early  (first  weak  of  February)  for  the 
"proposed"  Reliance  lead  and  any  parallel  contractor  study  effort 
to  flesh-out  appropriate  alternatives. 
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A  milestone  chart  is  attached  that  identifies  IW  Reliance 
approval  dates,  schedules  for  development  of  the  May  1,  1992, 
response  to  the  Congress,  and  schedules  for  the  formulation  end 
review  of  electronic  combat  consolidation  alternatives.  Any 
comments  on  or  disagreement  with  the  milestones  identified  should 
be  provided  to  me  by  February  12,  1992.  In  the  absence  of  any 
comments,  va  will  proceed  with  the  schedule  as  outlined  on  the 
attached  chart. 

The  "tiger”  team  should  plan  on  meeting  onoe  every  two  weeks 
to  reviev  progress  and  address  any  issues  that  may  arise.  I  will 
notify  team  members  of  meetings. 


Parker  C.  Horner 
Executive  Secretary 

Test  and  Evaluation  Resource  Committee 


Approve 


Attachment 
cc:  DDDRE(TiE) 
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